Device that controls flight altitude of unmanned aerial vehicle

ABSTRACT

A device controls a movement direction of an unmanned aerial vehicle having mounted thereon an imaging device that captures an image. The device includes one or more memories and a processor which, in operation, recognizes, as a plurality of markers, a plurality of objects from the image captured by the imaging device, each of the plurality of markers attached to one of the plurality of objects. The processor further calculates an area of a polygon formed by the plurality of markers, and controls the movement direction of the unmanned aerial vehicle such that the area of the polygon is maximized.

CROSS REFERENCE TO RELATED APPLICATIONS

This is a continuation application of U.S. patent application Ser. No.15/387,576, filed Dec. 21, 2016, which claims the benefit of JapanesePatent Application No. 2016-014124, filed Jan. 28, 2016, and uponJapanese Application No. 2016-175206, filed Sep. 8, 2016. The entiredisclosure of each of the above-identified applications, including thespecification, drawings, and claims, is incorporated herein by referencein its entirety.

BACKGROUND 1. Technical Field

The present disclosure relates to a flight altitude control device thatcontrols the flight altitude of an unmanned aerial vehicle havingmounted thereon an imaging device that captures images of the ground,and relates to an unmanned aerial vehicle, a flight altitude controlmethod, and a recording medium having recorded thereon a flight altitudecontrol program.

2. Description of the Related Art

As a conventional method for controlling the flight of an unmannedaerial vehicle, a human operator generally operates the unmanned aerialvehicle while observing the unmanned aerial vehicle, and the flightaltitude at the time of operating is controlled according to theobservations of the operator.

Furthermore, conventional methods for controlling the flight altitude ofan unmanned aerial vehicle include controlling a hovering operation at apreset altitude (for example, see Japanese Unexamined Patent ApplicationPublication No. 2006-27331). A method for collecting aerial imageinformation described in this Japanese Unexamined Patent ApplicationPublication No. 2006-27331 discloses a technique for controlling flightby measuring the distance (altitude) between a reference point on theground and an unmanned aerial vehicle.

SUMMARY

However, further improvement is required in the aforementioned methodfor collecting aerial image information.

In one general aspect, the techniques disclosed here feature a devicethat controls the flight altitude of an unmanned aerial vehicle havingmounted thereon an imaging device that captures an image of the ground,the device being provided with: one or more memories; and circuitrywhich, in operation, recognizes, as a plurality of markers, a pluralityof objects located on the ground from the image captured by the imagingdevice, calculates the area of a polygon formed by the plurality ofmarkers, and controls the flight altitude of the unmanned aerial vehiclein such a way that the area of the polygon is maximized.

It should be noted that general or specific aspects hereof may berealized by a device, a system, an integrated circuit, a computerprogram, or a recording medium such as a computer-readable CD-ROM, andmay be realized by any combination of a device, a system, a method, acomputer program, and a recording medium.

According to the present disclosure, it is possible to automaticallyadjust the flight altitude of an unmanned aerial vehicle, and toappropriately capture an image of an object on the ground serving as animaging subject.

It should be noted that further effects and advantages of the presentdisclosure will become apparent from the details disclosed in thepresent specification and drawings. Additional benefits and/oradvantages may be individually obtained by the various embodiments andfeatures of the specification and drawings, which need not all beprovided in order to obtain one or more of such benefits and/oradvantages.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram depicting an example of a configuration of aflight altitude control system in embodiment 1 of the presentdisclosure;

FIG. 2 is a block diagram depicting an example of a configuration of aserver device and an unmanned aerial vehicle depicted in FIG. 1;

FIG. 3 is a diagram depicting an example of the external appearance ofthe unmanned aerial vehicle depicted in FIG. 2;

FIG. 4 is a diagram depicting an example of data retained by a markernumber storage unit depicted in FIG. 2;

FIG. 5 is an image diagram depicting an example of a state in which theunmanned aerial vehicle depicted in FIG. 2 is capturing an image of aplurality of ground-based robots;

FIG. 6 is a diagram depicting an example of a polygon when theground-based robots depicted in FIG. 5 serve as markers;

FIG. 7 is a flowchart depicting an example of flight altitude controlprocessing performed by the server device depicted in FIG. 2;

FIG. 8 is a block diagram depicting an example of a configuration of aflight altitude control system in embodiment 2 of the presentdisclosure;

FIG. 9 is a first flowchart depicting an example of flight altitudecontrol processing performed by the server device depicted in FIG. 8;

FIG. 10 is a second flowchart depicting an example of flight altitudecontrol processing performed by the server device depicted in FIG. 8;

FIG. 11 is a block diagram depicting an example of a configuration of aflight altitude control system in embodiment 3 of the presentdisclosure;

FIG. 12 is a diagram depicting an example of an input screen displayedon a display unit depicted in FIG. 11;

FIG. 13 is a diagram depicting an example of data retained by a markerselection unit depicted in FIG. 11;

FIG. 14 is a first flowchart depicting an example of flight altitudecontrol processing performed by the server device depicted in FIG. 11;and

FIG. 15 is a second flowchart depicting an example of flight altitudecontrol processing performed by the server device depicted in FIG. 11.

DETAILED DESCRIPTION (Findings Forming the Basis for the PresentDisclosure)

The present disclosure relates to a flight altitude control system forcontrolling the flight altitude of an unmanned aerial vehicle havingmounted thereon an imaging device (for example, a camera). This flightaltitude control system is used when, for example, robots, people, orthe like deployed/positioned on the ground carry out activities such asrescues in a disaster-affected area at the time of a disaster or thelike, in order for an unmanned aerial vehicle flying over thedisaster-affected area to capture images of the disaster-affected areausing a camera, and to share information regarding the disaster-affectedarea required for the activities on the basis of the captured images.

When a plurality of robots or people carry out activities in acooperative manner, it is necessary to comprehend the statuses of theserobots or people themselves, the situations around these robots orpeople, and so forth. That is, it is necessary to acquire requiredinformation for which the robots, people, or the likedeployed/positioned on the ground serve as imaging subjects.

In order to appropriately capture an image of ground to be observed suchas a disaster-affected area by using a camera mounted on an unmannedaerial vehicle, it is necessary to determine an altitude that allowsappropriate imaging of a region of interest the user wishes to capture,and to control the flight altitude of the unmanned aerial vehicle.However, when the observation subject is a region for which there is noexisting map or a region for which the most up-to-date status is unclearsuch as a disaster-affected area, it is difficult to decide anappropriate route or altitude in advance.

In the aforementioned conventional method for collecting aerial imageinformation, a predetermined distance is maintained in accordance withthe distance to a reference point, and in order to appropriately capturean image of an object on the ground serving as an imaging subject, theuser has to set an appropriate altitude in advance. Therefore, when theobservation subject is a region for which there is no existing map or aregion for which the most up-to-date status is unclear such as adisaster-affected area, there has been a problem in that it has not beenpossible to appropriately capture an image of an object on the groundserving as an imaging subject.

A method according to an aspect of the present disclosure includes:recognizing, as a plurality of markers, a plurality of objects locatedon the ground from an image captured by an imaging device mounted on anunmanned aerial vehicle; calculating the area of a polygon formed by theplurality of markers; and controlling the flight altitude of theunmanned aerial vehicle in such a way that the area of the polygon ismaximized. Thus, the flight altitude of the unmanned aerial vehicle isautomatically adjusted, and it therefore becomes possible for the cameramounted on the unmanned aerial vehicle to appropriately capture an imageof a region of interest decided in accordance with the markers, as aregion in which all of the objects to be captured are enlarged to thegreatest extent from among objects on the ground such as robots orpeople.

A device according to an aspect of the present disclosure controls theflight altitude of an unmanned aerial vehicle having mounted thereon animaging device that captures an image of the ground, the device beingprovided with: one or more memories; and circuitry which, in operation,recognizes, as a plurality of markers, a plurality of objects located onthe ground from the image captured by the imaging device, calculates thearea of a polygon formed by the plurality of markers, and controls theflight altitude of the unmanned aerial vehicle in such a way that thearea of the polygon is maximized.

According to this kind of configuration, due to the plurality of objectslocated on the ground being recognized as a plurality of markers fromthe image captured by the imaging device, the area of the polygon formedby the plurality of markers being calculated, and the flight altitude ofthe unmanned aerial vehicle being controlled in such a way that the areaof the polygon is maximized, it is possible to appropriately capture aregion of interest designated by the markers on the ground. As a result,it is possible to automatically adjust the flight altitude of theunmanned aerial vehicle, and to appropriately capture an image of theobjects on the ground serving as imaging subjects.

The device may be further provided with: a first memory that stores thenumber of the markers to be recognized by the circuitry, as a registeredmarker number, in which the circuitry may compare the number of theplurality of markers and the registered marker number, and, when thenumber of the plurality of markers is less than the registered markernumber, perform control that increases the flight altitude of theunmanned aerial vehicle, and, when the number of the plurality ofmarkers matches the registered marker number, and the area of thepolygon is smaller than the area of the polygon previously calculated,perform control that decreases the flight altitude of the unmannedaerial vehicle.

According to this kind of configuration, when the number of theplurality of markers recognized and the registered marker number storedin advance are compared and the number of the plurality of markers isless than the registered marker number, control that increases theflight altitude of the unmanned aerial vehicle is performed, andtherefore, by raising the unmanned aerial vehicle, it is possible toincrease the number of captured markers to match the registered markernumber, and to appropriately capture an image of a region of interestdesignated by the registered marker number. Furthermore, when the numberof the plurality of markers matches the registered marker number, andthe area of the polygon is smaller than the area of the polygonpreviously calculated, control that decreases the flight altitude of theunmanned aerial vehicle is performed, and therefore, by lowering theunmanned aerial vehicle, it is possible to appropriately capture animage of a region of interest designated by the registered markernumber, with the region of interest having been enlarged as much aspossible.

The imaging device may include a zoom imaging device capable of a zoomoperation, and the circuitry, when the number of the plurality ofmarkers matches the registered marker number, and the area of thepolygon is equal to or larger than the area of the polygon previouslycalculated, may perform control that maintains the flight altitude ofthe unmanned aerial vehicle at the present flight altitude, recognizethe plurality of objects as the plurality of markers, from the imagecaptured by the imaging device while the flight altitude of the unmannedaerial vehicle is maintained at the present flight altitude, calculate,as an altitude-maintained area, the area of the polygon formed by theplurality of markers recognized while the flight altitude of theunmanned aerial vehicle is maintained at the present flight altitude,and control the zoom ratio of the zoom imaging device in such a way thatthe altitude-maintained area is maximized.

According to this kind of configuration, when the number of theplurality of markers matches the registered marker number, and the areaof the polygon is equal to or larger than the area of the polygonpreviously calculated, control that maintains the flight altitude of theunmanned aerial vehicle at the present flight altitude is performed, theplurality of objects are recognized as the plurality of markers, fromthe image captured by the imaging device while the flight altitude ofthe unmanned aerial vehicle is maintained at the present flightaltitude, the area of the polygon formed by the plurality of markersrecognized while the flight altitude of the unmanned aerial vehicle ismaintained at the present flight altitude is calculated as thealtitude-maintained area, and the zoom ratio of the zoom imaging deviceis controlled in such a way that the altitude-maintained area ismaximized, and therefore, due to the zoom ratio of the zoom imagingdevice being controlled while the flight altitude of the unmanned aerialvehicle is maintained, it is possible to appropriately capture an imageof the region of interest designated by the registered marker number.

When the number of the plurality of markers recognized while the flightaltitude of the unmanned aerial vehicle is maintained at the presentflight altitude is less than the registered marker number, the circuitrymay control the zoom imaging device in such a way that the zoom imagingdevice zooms out.

According to this kind of configuration, when the number of theplurality of markers recognized while the flight altitude of theunmanned aerial vehicle is maintained at the present flight altitude isless than the registered marker number, the zoom imaging device zoomsout, and therefore, due to the zoom-out operation of the zoom imagingdevice, it is possible to increase the number of the captured markers tomatch the registered marker number, and to appropriately capture animage of the region of interest designated by the number of registeredmarkers.

When the zoom imaging device cannot zoom out, the circuitry may performcontrol that maintains the present zoom ratio of the zoom imagingdevice, and perform control that increases the flight altitude of theunmanned aerial vehicle.

According to this kind of configuration, when the zoom imaging devicecannot zoom out, control that increases the flight altitude of theunmanned aerial vehicle is performed while control that maintains thepresent zoom ratio of the zoom imaging device is performed, andtherefore, by raising the unmanned aerial vehicle, it is possible toincrease the number of captured markers to the registered marker number,and to appropriately capture an image of the region of interestdesignated by the registered marker number, even when the zoom imagingdevice cannot zoom out.

When the number of the plurality of markers recognized while the flightaltitude of the unmanned aerial vehicle is maintained at the presentflight altitude matches the registered marker number, and thealtitude-maintained area is smaller than the altitude-maintained areapreviously calculated, the circuitry may control the zoom imaging devicein such a way that the zoom imaging device zooms in.

According to this kind of configuration, when the number of theplurality of markers recognized while the flight altitude of theunmanned aerial vehicle is maintained at the present flight altitudematches the registered marker number, and the presentaltitude-maintained area is smaller than the altitude-maintained areapreviously calculated, the zoom imaging device zooms in, and therefore,due to the zoom-in operation of the zoom imaging device, it is possibleto appropriately capture an image of the region of interest designatedby the registered marker number, with the region of interest having beenenlarged as much as possible.

When the zoom imaging device cannot zoom in, the circuitry may performcontrol that maintains the present zoom ratio of the zoom imagingdevice, and perform control that decreases the flight altitude of theunmanned aerial vehicle.

According to this kind of configuration, when the zoom imaging devicecannot zoom in, control that decreases the flight altitude of theunmanned aerial vehicle is performed while control that maintains thepresent zoom ratio of the zoom imaging device is performed, andtherefore, by lowering the unmanned aerial vehicle, it is possible toappropriately capture an image of the region of interest designated bythe registered marker number, with the region of interest having beenenlarged as much as possible.

The circuitry may acquire, as a plurality of recognition-subjectmarkers, a plurality of objects selected by a user from among theplurality of objects, recognize the plurality of recognition-subjectmarkers as the plurality of markers, from the image captured by theimaging device, and calculate the area of the polygon formed by theplurality of recognition-subject markers.

According to this kind of configuration, the plurality of objectsselected by the user from among the plurality of objects are acquired asa plurality of recognition-subject markers, the plurality ofrecognition-subject markers are recognized as the plurality of markers,from an image captured by the imaging device, and the area of thepolygon formed by the plurality of recognition-subject markers iscalculated, and it is therefore possible to appropriately capture animage of the region of interest designated by the plurality of objectsselected by the user.

The circuitry may acquire, as the plurality of recognition-subjectmarkers, the plurality of markers selected by the user from among theplurality of markers, which are displayed superimposed on the imagecaptured by the imaging device.

According to this kind of configuration, a plurality of markers aredisplayed superimposed on a captured image, and a plurality of markersselected by the user from among the plurality of displayed markers areacquired as a plurality of recognition-subject markers, and thereforethe user can easily designate a desired region as a region of interestby the simple operation of selecting arbitrary markers from a capturedimage.

An unmanned aerial vehicle according to another aspect of the presentdisclosure is provided with: an imaging device that captures an image ofthe ground; and circuitry which, in operation, recognizes, as aplurality of markers, a plurality of objects located on the ground fromthe image captured by the imaging device, calculates the area of apolygon formed by the plurality of markers, and controls the flightaltitude of the unmanned aerial vehicle in such a way that the area ofthe polygon is maximized. In this case, the same effect as that of theaforementioned device can be demonstrated.

Furthermore, it is possible for the present disclosure to not only berealized as a device or an unmanned aerial vehicle provided with acharacteristic configuration such as that mentioned above, but to alsobe realized as a method or the like for executing characteristicprocessing corresponding to the characteristic configuration provided inthe device. Furthermore, it is also possible for the present disclosureto be realized as a recording medium having recorded thereon a computerprogram that causes a computer to execute the characteristic processingincluded in this kind of method. Consequently, the same effect as thatof the aforementioned device can be demonstrated also in the otheraspects described below.

A method according to another aspect of the present disclosure includes:recognizing, as a plurality of markers, a plurality of objects locatedon the ground from an image captured by an imaging device mounted on anunmanned aerial vehicle; calculating the area of a polygon formed by theplurality of markers; and controlling the flight altitude of theunmanned aerial vehicle in such a way that the area of the polygon ismaximized.

A recording medium according to another aspect of the present disclosureis a computer-readable non-transitory recording medium having recordedthereon a program that controls an unmanned aerial vehicle havingmounted thereon an imaging device that captures an image of the ground,in which the program, when executed by a processor, causes the processorto execute a method including: recognizing, as a plurality of markers, aplurality of objects located on the ground from the image captured bythe imaging device; calculating the area of a polygon formed by theplurality of markers; and controlling the flight altitude of theunmanned aerial vehicle in such a way that the area of the polygon ismaximized.

Also, it goes without saying a computer program such as theaforementioned can be distributed by way of a computer-readablenon-transitory recording medium such as a CD-ROM or a communicationnetwork such as the Internet. Furthermore, the present disclosure may beconfigured as a system in which some constituent elements and otherconstituent elements of a flight altitude control device according to anembodiment of the present disclosure are distributed among a pluralityof computers.

It should be noted that the embodiments described hereinafter are allintended to represent a specific example of the present disclosure. Thenumerical values, the shapes, the constituent elements, the steps, theorder of the steps, and the like given in the following embodiments areexamples and are not intended to restrict the present disclosure.Furthermore, from among the constituent elements in the followingembodiments, constituent elements that are not described in theindependent claims indicating the most significant concepts aredescribed as optional constituent elements. Furthermore, in all of theembodiments, it is also possible to combine the respective contentthereof.

Hereafter, embodiments of the present disclosure will be described withreference to the drawings.

Embodiment 1

A flight altitude control system according to embodiment 1 of thepresent disclosure uses autonomous mobile robots positioned on theground (ground-based robots) as markers, and controls the flightaltitude of an unmanned aerial vehicle in such a way that an imagingdevice mounted on the unmanned aerial vehicle captures all of themarkers in an image taken by the imaging device.

FIG. 1 is a block diagram depicting an example of a configuration of theflight altitude control system in embodiment 1 of the presentdisclosure. The flight altitude control system depicted in FIG. 1 isprovided with a server device 1 and an unmanned aerial vehicle 2, andthe server device 1 and the unmanned aerial vehicle 2 are connected viaa wired or wireless network NW and configured in such a way that avariety of information can be mutually communicated. It should be notedthat, when a user (operator) remotely controls the unmanned aerialvehicle 2 using an external control device (controller), the controlleris also connected via the network NW or the like and configured in sucha way that a variety of information can be mutually communicated. Thesame is also true for other embodiments.

The server device 1 is provided with a function serving as a flightaltitude control device. Specifically, the server device 1 receives animage captured by a camera, which is an example of the imaging devicemounted on the unmanned aerial vehicle 2, via the network NW, determinesthe flight altitude of the unmanned aerial vehicle 2, and controls theflight altitude of the unmanned aerial vehicle 2.

FIG. 2 is a block diagram depicting an example of a configuration of theserver device 1 and the unmanned aerial vehicle 2 depicted in FIG. 1,and FIG. 3 is a diagram depicting an example of the external appearanceof the unmanned aerial vehicle depicted in FIG. 2. It should be notedthat, in order to simplify the diagram, the network NW has not beendepicted in FIG. 2, The same is also true for other embodiments.

In FIG. 2, the server device 1 is provided with a communication unit 11,a marker recognition unit 12, an area calculation unit 13, amaximum-value detection unit 14, a flight altitude control unit 15, anda marker number storage unit 16. The unmanned aerial vehicle 2 isprovided with a communication unit 21, a camera 22, a flight controlunit 23, and driving units 24.

The communication unit 21 of the unmanned aerial vehicle 2, via thenetwork NW (not depicted), communicates with the communication unit 11of the server device 1, transmits an image or the like captured by thecamera 22 to the communication unit 11, and receives various controlcommands or the like generated by the server device 1 from thecommunication unit 11.

The camera 22 is mounted on the unmanned aerial vehicle 2, and capturesimages of objects, for example, ground-based robots, that serve asmarkers deployed below the unmanned aerial vehicle 2. Here, as thecamera 22, an example is given in which a camera having a fixed-focuslens is used. The camera 22 transmits a captured image (image data) tothe communication unit 11 via the communication unit 21.

Here, referring to FIG. 3, the unmanned aerial vehicle 2 is providedwith, in addition to the above configuration, a main body 25, foursupport units 26, and four driving units 24 (the driving units 24depicted in FIG. 2) that generate a driving force for the unmannedaerial vehicle 2. It should be noted that, in order to simplify thediagram, the four driving units 24 are depicted as one block in FIG. 2,The same is also true for other embodiments.

The camera 22 is attached to the bottom section of the main body 25. Thedriving units 24 are attached to the tip ends of the support units 26,which extend in four directions from the main body 25. The communicationunit 21 and the flight control unit 23 depicted in FIG. 2 are housedinside the main body 25.

Referring to FIG. 2 once again, the flight control unit 23 controls theflight state including the flight altitude of the unmanned aerialvehicle 2. The driving units 24 are made up of a propeller and a motorthat rotates the propeller. The flight control unit 23 controls themovement direction, the flight altitude, and the like of the unmannedaerial vehicle 2 by appropriately controlling the rotational speed ofthe propellers of the driving units 24. In FIG. 3, the unmanned aerialvehicle 2 has the four driving units 24; however, it should be notedthat the unmanned aerial vehicle 2 is not restricted thereto and may usefive or more driving units, for example. The same is also true for otherembodiments.

The marker recognition unit 12 of the server device 1 acquires an imagecaptured by the camera 22 via the communication unit 21, and recognizes,as markers, ground-based robots captured by the camera 22. For example,the marker recognition unit 12 is configured of an image processingdevice that recognizes objects such as people or ground-based robots,and by attaching specific lamps or light-emitting bodies to theground-based robots or people to serve as markers and making the lampsor the light-emitting bodies light up or blink, the lamps or thelight-emitting bodies are detected from an image captured by the camera22 and the ground-based robots or people are recognized as markers.

It should be noted that the configuration of the marker recognition unit12 is not particularly restricted to the aforementioned example, and maybe implemented in such a way that a mark like a bar code such as OR code(registered trademark) is arranged on or affixed to objects such aspeople or ground-based robots, the bar code-like marks are detected, andthe objects such as the ground-based robots or people are recognized asmarkers. Furthermore, the objects that are recognized as markers are notparticularly restricted to the aforementioned examples, and may bevarious types of work robots, emergency vehicles (fire engines,ambulances, police vehicles, or the like), construction vehicles(bulldozers, excavators, cranes, or the like), or the like. The same isalso true for other embodiments.

The marker number storage unit 16 stores a preset number of markers as aregistered marker number. FIG. 4 is a diagram depicting an example ofdata retained by the marker number storage unit 16. As depicted in FIG.4, the number of ground-based robots deployed on the ground is stored inthe marker number storage unit 16 in advance, and in the presentexample, “5” is stored as the registered marker number, for example.

The marker recognition unit 12 compares the number of the plurality ofrecognized markers and the registered marker number stored in the markernumber storage unit 16, outputs the comparison result to the flightaltitude control unit 15, and also outputs the image captured by thecamera 22 and the comparison result to the area calculation unit 13.

When the number of markers recognized by the marker recognition unit 12matches the registered marker number registered in advance in the markernumber storage unit 16, the area calculation unit 13 detects thepositions of the markers using the image captured by the camera 22,calculates the area of a polygon formed by the number of markers thatmatches the registered marker number, and outputs the calculated area ofthe polygon to the maximum-value detection unit 14. Here, various typesof areas can be used as the area of a polygon; for example, the area ofa polygon on the image formed by the markers may be calculated, or theactual area of a polygon formed from the actual positions of theground-based robots that correspond to the markers may be calculated.

The maximum-value detection unit 14 detects whether or not the area ofthe polygon calculated by the area calculation unit 13 is the maximum,while the flight altitude of the unmanned aerial vehicle 2 is controlledby the flight altitude control unit 15. Specifically, the maximum-valuedetection unit 14 has a function to store the area of the polygoncalculated by the area calculation unit 13, performs processing thatcompares the previous area of the polygon and the most up-to-date areaof the polygon to detect the maximum value, and outputs the comparisonresult to the flight altitude control unit 15.

The flight altitude control unit 15 controls the flight altitude of theunmanned aerial vehicle 2 on which the camera 22 is mounted, in such away that the area of the polygon is maximized, on the basis of thecomparison result of the marker recognition unit 12 and the comparisonresult of the maximum-value detection unit 14. Specifically, when thenumber of the plurality of markers recognized by the marker recognitionunit 12 is less than the registered marker number, the flight altitudecontrol unit 15 creates a control command for controlling the flightaltitude of the unmanned aerial vehicle 2 in such a way that the flightaltitude of the unmanned aerial vehicle 2 is increased, and transmitsthe created control command to the unmanned aerial vehicle 2 via thecommunication unit 11. Furthermore, when the number of the plurality ofmarkers matches the registered marker number, and the area of thepolygon is smaller than the area of the polygon previously calculated,the flight altitude control unit 15 creates a control command forcontrolling the flight altitude of the unmanned aerial vehicle 2 in sucha way that the flight altitude of the unmanned aerial vehicle 2 isdecreased, and transmits the created control command to the unmannedaerial vehicle 2 via the communication unit 11.

The communication unit 21 of the unmanned aerial vehicle 2 receives thecontrol command from the server device 1 and outputs the control commandto the flight control unit 23. The flight control unit 23 controls thedriving units 24 according to the control command, and increases theflight altitude of the unmanned aerial vehicle 2 when the number of theplurality of markers recognized by the marker recognition unit 12 isless than the registered marker number. Furthermore, the flight controlunit 23 decreases the flight altitude of the unmanned aerial vehicle 2when the number of the plurality of markers matches the registeredmarker number and the area of the polygon is smaller than the area ofthe polygon previously calculated.

As mentioned above, the flight altitude control unit 15 of the serverdevice 1 transmits a command (control command) for controlling altitudeto the unmanned aerial vehicle 2, and the unmanned aerial vehicle 2controls the altitude thereof according to the received command,Furthermore, the server device 1 receives the image captured by thecamera 22 of the unmanned aerial vehicle 2, and provides an analysisresult obtained using the received image, to various devices or the like(not depicted) as information that is necessary for the plurality ofground-based robots to carry out activities in a cooperative manner.

In the present embodiment, an example in which the server device 1functions as a flight altitude control device has been described;however, it should be noted that a configuration in which the unmannedaerial vehicle 2 is provided with a function serving as a flightaltitude control device may be implemented. In this case, the unmannedaerial vehicle 2 is further provided with the marker recognition unit12, the area calculation unit 13, the maximum-value detection unit 14,the flight altitude control unit 15, and the marker number storage unit16, and controls the altitude thereof using an image captured by thecamera 22 mounted thereon. Furthermore, a control device which isexternal to an unmanned aerial vehicle that is connected wirelessly orby means of optical communication or the like, for example, a PROPOcontroller, may also function as a flight altitude control device. Thesame is also true for other embodiments.

According to the above configuration, the unmanned aerial vehicle 2 isconstantly capturing images of below the position where the unmannedaerial vehicle 2 is flying, by means of the camera 22. The plurality ofground-based robots that serve as markers are deployed on the groundbelow the unmanned aerial vehicle 2, and, due to the camera 22 capturingan image thereof, the server device 1 generates a polygon in which thepositions of the ground-based robots serve as vertices.

FIG. 5 is an image diagram depicting an example of a state in which theunmanned aerial vehicle 2 depicted in FIG. 2 is capturing an image ofthe plurality of ground-based robots. The example depicted in FIG. 5 isan example in which the unmanned aerial vehicle 2 is flying in the sky,and there are five ground-based robots 4 positioned below the positionwhere the unmanned aerial vehicle 2 is flying. Each of the robots 4 isprovided with a lamp 41, for example, and the lamp 41 is made to lightup with a predetermined light emission color. At such time, the unmannedaerial vehicle 2 constantly captures images of below the position wherethe unmanned aerial vehicle 2 is flying, by means of the camera 22, theserver device 1 recognizes the lamps 41 of the five ground-based robots4 as markers from a captured image, and controls the flight altitude ofthe unmanned aerial vehicle 2 in such a way that all of the lamps 41 ofthe five ground-based robots 4 are within a region of interest AA, whichis a region that can be captured by the camera 22 of the unmanned aerialvehicle 2.

FIG. 6 is a diagram depicting an example of a polygon when theground-based robots 4 depicted in FIG. 5 serve as markers. As depictedin FIG. 6, the server device 1 recognizes the lamps 41 of the fiveground-based robots 4 as markers M1 to M5, and calculates the area of apolygon PS formed from the five markers M1 to M5.

Here, in the present embodiment, if the flight altitude of the unmannedaerial vehicle 2 is low, it is assumed that the number of markerscaptured by the camera 22 does not reach the preset number of markers(registered marker number). In other words, a polygon in which thenumber of markers serves as vertices is not drawn.

Therefore, the server device 1, as an initial state, increases theflight altitude of the unmanned aerial vehicle 2 until the number ofmarkers reaches the registered marker number. Thereby, a polygon inwhich the number of markers serves as the number of vertices isobtained. In the process of the unmanned aerial vehicle 2 monotonouslyincreasing the flight altitude, the camera 22 starts capturing images ofthe ground-based robots serving as markers (hereinafter, also referredto as “markers”). When the camera 22 captures the markers, the markerrecognition unit 12 recognizes the ground-based robots 4 as markers, andstarts counting the number of markers. Thereafter, the unmanned aerialvehicle 2 rises until the number of markers reaches the presetregistered marker number.

When the unmanned aerial vehicle 2 continues to rise and the number ofmarkers matches the registered marker number, a polygon in which themarkers serve as vertices can be recognized, and therefore the areacalculation unit 13 calculates the area of the polygon formed by themarkers.

Thereafter, the area of the polygon is related to the flight altitude ofthe unmanned aerial vehicle 2, and, when the flight altitude of theunmanned aerial vehicle 2 is increased, the area of the polygondecreases. On the other hand, when the flight altitude of the unmannedaerial vehicle 2 is decreased, the area of the polygon increases, andeventually the markers fall outside of the angle of view of the camera22, and therefore a state is entered where it is not possible to detecta polygon in which markers of the preset registered marker number serveas vertices.

At such time, the flight altitude control unit 15 changes the flightaltitude of the unmanned aerial vehicle 2, and, based on the comparisonresult of the maximum-value detection unit 14, determines the flightaltitude of the unmanned aerial vehicle 2 in such a way that the area ofthe polygon captured by the camera 22 is maximized. Furthermore, theground-based robots 4 that constitute markers are constantly moving, andtherefore the area of the polygon changes from moment to moment. Themaximum-value detection unit 14 sequentially compares this changing areaof the polygon, and the flight altitude control unit 15 controls theflight altitude of the unmanned aerial vehicle 2 in such a way that thearea of the polygon drawn by the markers is maximized.

Next, flight altitude control processing performed by the server device1 depicted in FIG. 2 will be described using the flowchart of FIG. 7.FIG. 7 is a flowchart depicting an example of flight altitude controlprocessing performed by the server device 1 depicted in FIG. 2.

In FIG. 7, first, the server device 1 starts flight altitude controlprocessing (step S101). Next, in step S102, the marker recognition unit12 acquires an image captured by the camera 22 and recognizes themarkers.

Next, in step S103, the marker recognition unit 12 compares the numberof recognized markers and the registered marker number stored in advancein the marker number storage unit 16. When the number of recognizedmarkers is less than the registered marker number (insufficient number),a transition is made to step S107, and the marker recognition unit 12notifies the flight altitude control unit 15 that the number ofrecognized markers is less than the registered marker number, andinstructs the flight altitude of the unmanned aerial vehicle 2 to beincreased. The flight altitude control unit 15 controls the flightaltitude of the unmanned aerial vehicle 2 in accordance with theinstruction.

On the other hand, when the number of recognized markers is theregistered marker number (the number is met), a transition is made tostep S104 in which the area of the polygon formed by the markers iscalculated. In step S104, the area calculation unit 13 detects thepositions of the markers using the image captured by the camera 22, andobtains the area of the polygon in which the detected markers serve asvertices.

Next, in step S105, the maximum-value detection unit 14, which storesthe previous area of the polygon, compares the previous area of thepolygon and the present area of the polygon calculated in step S104.When the present area of the polygon is smaller than the previous areaof the polygon, a transition is made to step S106, and the maximum-valuedetection unit 14 notifies the flight altitude control unit 15 that thepresent area of the polygon is smaller than the previous area of thepolygon, and instructs the flight altitude control unit 15 to decreasethe altitude of the unmanned aerial vehicle. The flight altitude controlunit 15 controls the flight altitude of the unmanned aerial vehicle 2 inaccordance with the instruction.

On the other hand, when the present area of the polygon is equal to orlarger than the previous area of the polygon, the maximum-valuedetection unit 14 notifies the flight altitude control unit 15 that thepresent area of the polygon is equal to or larger than the previous areaof the polygon, and the flight altitude control unit 15, whilemaintaining that flight altitude, transitions to step S101 (step S108)and repeats the processing thereafter.

It should be noted that, as an initial state, the unmanned aerialvehicle 2 may be raised to an altitude at which all of the markers arecaptured in advance, in accordance with a manual operation performed bythe operator of the unmanned aerial vehicle 2, and then the processingdepicted in FIG. 7 may be carried out. Furthermore, the maximum-valuedetection unit 14 sets the initial value of the previous area of thepolygon to “0”. The same is also true for other embodiments.

According to the aforementioned processing, the server device 1recognizes, as markers, the ground-based robots 4 captured using thecamera 22 mounted on the unmanned aerial vehicle 2, and flies theunmanned aerial vehicle 2 at an altitude that enables capturing of animage in which a polygon having the markers as vertices is formed andthe area of the polygon is maximized. Thereby, the flight altitude ofthe unmanned aerial vehicle 2 reaches the optimum altitude for capturingthe region of interest as an image using the mounted camera 22, and canappropriately capture the region of interest designated by the markerson the ground.

In the present embodiment, ground-based robots are used as markers;however, it should be noted that any objects may be used as markersprovided that the objects can be recognized as markers by the markerrecognition unit 12 even if the objects are not robots. The same is alsotrue for other embodiments.

Embodiment 2

A flight altitude control system according to embodiment 2 of thepresent disclosure controls the flight altitude of an unmanned aerialvehicle having an imaging device equipped with a zoom lens mountedthereon, and also controls the zoom ratio of the imaging device.

FIG. 8 is a block diagram depicting an example of a configuration of theflight altitude control system in embodiment 2 of the presentdisclosure. It should be noted that, in FIG. 8, constituent elementsthat are the same as those in FIG. 2 are denoted by the same referencenumerals, and detailed descriptions thereof are omitted.

In FIG. 8, the flight altitude control system of the present embodimentis provided with a server device 1 a and an unmanned aerial vehicle 2 a.The server device 1 a is provided with a communication unit 11, a markerrecognition unit 12, an area calculation unit 13, a maximum-valuedetection unit 14, a flight altitude control unit 15, a marker numberstorage unit 16, and a zoom ratio control unit 17. The unmanned aerialvehicle 2 a is provided with a communication unit 21, a camera 22 a, aflight control unit 23, driving units 24, and a camera control unit 27.

The communication unit 21 of the unmanned aerial vehicle 2 a, via anetwork NW (not depicted), communicates with the communication unit 11of the server device 1 a, transmits an image or the like captured by thecamera 22 a to the communication unit 11, and receives various controlcommands or the like generated by the server device 1 a from thecommunication unit 11.

The camera 22 a is mounted on the unmanned aerial vehicle 2 a, andcaptures images of objects, for example, ground-based robots, that serveas markers deployed below the unmanned aerial vehicle 2 a. Here, as thecamera 22 a, an example is given in which a camera having a zoom lensmounted thereon (a zoom lens camera) is used, The camera 22 a transmitsa captured image (image data) to the communication unit 11 via thecommunication unit 21.

The unmanned aerial vehicle 2 a has the same external appearance as theunmanned aerial vehicle 2 depicted in FIG. 3, and the camera 22 a isattached to the bottom section of a main body 25 (not depicted). Thedriving units 24 are attached to the tip ends of support units 26 (notdepicted) that extend in four directions from the main body 25. Thecommunication unit 21, the flight control unit 23, and the cameracontrol unit 27 depicted in FIG. 8 are housed inside the main body 25.

The flight control unit 23 controls the flight state including theflight altitude of the unmanned aerial vehicle 2 a. The driving units 24are made up of a propeller and a motor that rotates the propeller. Theflight control unit 23 controls the movement direction, the flightaltitude, and the like of the unmanned aerial vehicle 2 a byappropriately controlling the rotational speed of the propellers of thedriving units 24. The camera control unit 27 controls a zoom operationof the camera 22 a.

The marker recognition unit 12 of the server device 1 a acquires animage captured by the camera 22 a via the communication unit 21, andrecognizes, as markers, ground-based robots captured by the camera 22.

The marker number storage unit 16 stores a preset number of markers as aregistered marker number. For example, the marker number storage unit 16retains the data (registered marker number) depicted in FIG. 4, and thenumber of ground-based robots deployed on the ground is registered inadvance in the marker number storage unit 16.

The marker recognition unit 12 compares the number of the plurality ofrecognized markers and the registered marker number stored in the markernumber storage unit 16, outputs the comparison result to the flightaltitude control unit 15, and also outputs the image captured by thecamera 22 a and the comparison result to the area calculation unit 13.

When the number of markers recognized by the marker recognition unit 12matches the registered marker number registered in advance in the markernumber storage unit 16, the area calculation unit 13 detects thepositions of the markers using the image captured by the camera 22 a,calculates the area of a polygon formed by the number of markers thatmatches the registered marker number, and outputs the calculated area ofthe polygon to the maximum-value detection unit 14.

The maximum-value detection unit 14 detects whether or not the area ofthe polygon is the maximum, while the flight altitude of the unmannedaerial vehicle 2 a is controlled by the flight altitude control unit 15.Specifically, the maximum-value detection unit 14 has a function tostore the area of the polygon calculated by the area calculation unit13, performs processing that compares the previous area of the polygonand the most up-to-date area of the polygon to detect the maximum value,and outputs the comparison result to the flight altitude control unit15.

The flight altitude control unit 15 controls the flight altitude of theunmanned aerial vehicle 2 a on which the camera 22 a is mounted, in sucha way that the area of the polygon is maximized, on the basis of thecomparison result of the marker recognition unit 12 and the comparisonresult of the maximum-value detection unit 14. Specifically, when thenumber of the plurality of markers recognized by the marker recognitionunit 12 is less than the registered marker number, the flight altitudecontrol unit 15 creates a control command for controlling the flightaltitude of the unmanned aerial vehicle 2 a in such a way that theflight altitude of the unmanned aerial vehicle 2 a is increased, andtransmits the created control command to the unmanned aerial vehicle 2 avia the communication unit 11. Furthermore, when the number of theplurality of markers matches the registered marker number, and the areaof the polygon is less than the area of the polygon previouslycalculated, the flight altitude control unit 15 creates a controlcommand for controlling the flight altitude of the unmanned aerialvehicle 2 a in such a way that the flight altitude of the unmannedaerial vehicle 2 a is decreased, and transmits the created controlcommand to the unmanned aerial vehicle 2 a via the communication unit11. In addition, when the number of the plurality of markers matches theregistered marker number, and the area of the polygon is equal to orgreater than the area of the polygon previously calculated, the flightaltitude control unit 15 creates a control command for controlling theflight altitude of the unmanned aerial vehicle 2 a in such a way thatthe flight altitude of the unmanned aerial vehicle 2 a is maintained,and transmits the created control command to the unmanned aerial vehicle2 a via the communication unit 11.

The zoom ratio control unit 17 controls the zoom ratio of the camera 22a mounted on the unmanned aerial vehicle 2 a. Specifically, the markerrecognition unit 12 recognizes the plurality of ground-based robots as aplurality of markers, from the image captured by the camera 22 a whilethe flight altitude of the unmanned aerial vehicle 2 a is maintained atthe present flight altitude. The area calculation unit 13 calculates, asan altitude-maintained area, the area of a polygon formed by theplurality of markers recognized while the flight altitude of theunmanned aerial vehicle 2 a is maintained at the present flightaltitude. The zoom ratio control unit 17 creates a control command forcontrolling the zoom ratio of the camera 22 a in such a way that thealtitude-maintained area is maximized, and transmits the created controlcommand to the unmanned aerial vehicle 2 a via the communication unit11.

Furthermore, when the number of the plurality of markers recognizedwhile the flight altitude of the unmanned aerial vehicle 2 a ismaintained at the present flight altitude is less than the registeredmarker number, the zoom ratio control unit 17 creates a control commandfor controlling the camera 22 a in such a way that the camera 22 a zoomsout, and transmits the created control command to the unmanned aerialvehicle 2 a via the communication unit 11. Here, when the camera 22 acannot zoom out, the zoom ratio control unit 17 creates a controlcommand for maintaining the present zoom ratio of the camera 22 a, andalso the flight altitude control unit 15 creates a control command forincreasing the flight altitude of the unmanned aerial vehicle 2 a, andeach of the created control commands is transmitted to the unmannedaerial vehicle 2 a via the communication unit 11.

Furthermore, when the number of the plurality of markers recognizedwhile the flight altitude of the unmanned aerial vehicle 2 a ismaintained at the present flight altitude matches the registered markernumber, and the altitude-maintained area is smaller than thealtitude-maintained area previously calculated, the zoom ratio controlunit 17 creates a control command for controlling the camera 22 a insuch a way that the camera 22 a zooms in, and transmits the createdcontrol command to the unmanned aerial vehicle 2 a via the communicationunit 11. Here, when the camera 22 a cannot zoom in, the zoom ratiocontrol unit 17 creates a control command for maintaining the presentzoom ratio of the camera 22 a, and also the flight altitude control unit15 creates a control command for decreasing the flight altitude of theunmanned aerial vehicle 2 a, and each of the created control commands istransmitted to the unmanned aerial vehicle 2 a via the communicationunit 11.

It should be noted that the configuration of the zoom ratio control unit17 is not particularly restricted to the aforementioned example, andvarious alterations are possible; for example, the zoom ratio controlunit 17 may be omitted, and the flight altitude control unit 15 mayexecute the function of the zoom ratio control unit 17.

According to the above configuration, the unmanned aerial vehicle 2 aconstantly captures images of below the position where the unmannedaerial vehicle 2 a is flying, by means of the camera 22 a. The regioncaptured by the camera 22 a of the unmanned aerial vehicle 2 a changesdepending on the flight altitude of the unmanned aerial vehicle 2 a andthe zoom ratio of the zoom lens mounted in the camera 22 a. That is, theregion being captured widens as the unmanned aerial vehicle 2 a causesthe zoom lens to zoom out from the tele (telephoto) side toward the wide(wide angle) side. Furthermore, the region being captured narrows as theunmanned aerial vehicle 2 a causes the zoom lens to zoom in from thewide (wide angle) side toward the tele (telephoto) side.

In the present embodiment, as an initial state, the zoom ratio of thecamera 22 a is set to the maximum value on the wide side (the wide end),in other words, to a state in which the greatest number of objects canbe captured at the maximum angle of view. A plurality of ground-basedrobots that serve as markers are deployed below the unmanned aerialvehicle 2 a, and, due to the camera 22 a capturing an image thereof, apolygon is generated in which the positions of the ground-based robotsserve as vertices. This situation is the same as the situation describedin FIG. 5 and FIG. 6.

Here, in the present embodiment, if the flight altitude of the unmannedaerial vehicle 2 a is low, it is assumed that the number of markerscaptured by the camera 22 a does not reach the preset number of markers(registered marker number).

Therefore, the server device 1 a, as an initial state, increases theflight altitude of the unmanned aerial vehicle 2 a until the number ofmarkers reaches the registered marker number. In the process of theunmanned aerial vehicle 2 a monotonously increasing the flight altitude,the camera 22 a starts capturing images of the ground-based robotsserving as markers (hereinafter, also referred to as “markers”). Whenthe camera 22 a captures the markers, the marker recognition unit 12recognizes the ground-based robots as markers, and starts counting thenumber of markers. Thereafter, the unmanned aerial vehicle 2 a risesuntil the number of markers reaches the preset registered marker number.

When the unmanned aerial vehicle 2 a continues to rise and the number ofmarkers matches the registered marker number, a polygon in which themarkers serve as vertices can be recognized, and therefore the areacalculation unit 13 calculates the area of the polygon formed with themarkers serving as vertices.

Thereafter, the area of the polygon is related to the flight altitude ofthe unmanned aerial vehicle 2 a, and, when the flight altitude of theunmanned aerial vehicle 2 a is increased, the area of the polygondecreases. On the other hand, when the flight altitude of the unmannedaerial vehicle 2 a is decreased, the area of the polygon increases, andeventually the markers fall outside of the angle of view of the camera22 a, and therefore a state is entered where it is not possible todetect a polygon in which markers of the preset registered marker numberserve as vertices.

Furthermore, the area of the polygon is related to the zoom ratio of thezoom lens of the camera 22 a, and, when the camera 22 a zooms out (movesfrom the tele side to the wide side), the area of the polygon decreases.On the other hand, when the camera 22 a zooms in (moves from the wideside to the tele side), the area of the polygon increases, and there isa possibility of a state eventually being entered where it is notpossible to detect a polygon in which markers of the preset registeredmarker number serve as vertices. Although, when the unmanned aerialvehicle 2 a is flying at a sufficiently high altitude, it is possiblefor a polygon to be drawn even when the zoom ratio of the camera 22 a ischanged to the tele end (a state in which zooming has been performed upto the maximum at the tele side).

At such time, the flight altitude control unit 15 changes the flightaltitude of the unmanned aerial vehicle 2 a, and, based on thecomparison result of the maximum-value detection unit 14, determines theflight altitude of the unmanned aerial vehicle 2 in such a way that thearea of the polygon captured by the camera 22 a is maximized.

In this case also, the ground-based robots that constitute markers areconstantly moving, and therefore the area of the polygon changes frommoment to moment. The maximum-value detection unit 14 sequentiallycalculates this changing area of the polygon as the altitude-maintainedarea, and the zoom ratio control unit 17 controls the zoom ratio of thecamera 22 a in such a way that the area of the polygon drawn by themarkers (the altitude-maintained area) is maximized.

Next, flight altitude control processing performed by the server device1 a depicted in FIG. 8 will be described using the flowcharts of FIG. 9and FIG. 10. FIG. 9 and FIG. 10 are first and second flowchartsdepicting an example of flight altitude control processing performed bythe server device 1 a depicted in FIG. 8. Here, the unmanned aerialvehicle 2 a is raised while the zoom ratio of the camera 22 a is set tothe wide side.

In FIG. 9, first, the server device la starts flight altitude controlprocessing (step S301), Next, in step S302, the marker recognition unit12 acquires an image captured by the camera 22 a and recognizes markers.

Next, in step S303, the marker recognition unit 12 compares the numberof recognized markers and the registered marker number stored in advancein the marker number storage unit 16. When the number of recognizedmarkers is less than the registered marker number (insufficient number),a transition is made to step S307, and the marker recognition unit 12notifies the flight altitude control unit 15 that the number ofrecognized markers is less than the registered marker number, andinstructs the flight altitude control unit 15 to increase the altitudeof the unmanned aerial vehicle. The flight altitude control unit 15controls the flight altitude of the unmanned aerial vehicle 2 a inaccordance with the instruction.

On the other hand, when the number of recognized markers is theregistered marker number (the number is met), a transition is made tostep S304 in which the area of a polygon formed by the markers iscalculated. In step S304, the area calculation unit 13 detects thepositions of the markers using the image captured by the camera 22 a,and obtains the area of the polygon in which the detected markers serveas vertices.

Next, in step S305, the maximum-value detection unit 14, which storesthe area of the polygon previously calculated, compares the previousarea of the polygon and the present area of the polygon calculated instep S304. When the present area of the polygon is smaller than theprevious area of the polygon, a transition is made to step S306, and themaximum-value detection unit 14 notifies the flight altitude controlunit 15 that the present area of the polygon is smaller than theprevious area of the polygon, and instructs the flight altitude controlunit 15 to decrease the altitude of the unmanned aerial vehicle. Theflight altitude control unit 15 controls the flight altitude of theunmanned aerial vehicle 2 a in accordance with the instruction.

On the other hand, when the present area of the polygon is equal to orlarger than the previous area of the polygon, the maximum-valuedetection unit 14 notifies the flight altitude control unit 15 that thepresent area of the polygon is equal to or larger than the previous areaof the polygon, and the flight altitude control unit 15, whilemaintaining that flight altitude, transitions to step S311 depicted inFIG. 10 (step S308).

Next, in FIG. 10, the server device 1 a starts adjustment processingaccording to the zoom ratio (step S311). Next, in step S312, the markerrecognition unit 12 acquires the image captured by the camera 22 a andrecognizes markers.

Next, in step S313, the marker recognition unit 12 compares the numberof recognized markers and the registered marker number stored in advancein the marker number storage unit 16. When the number of recognizedmarkers is less than the registered marker number (insufficient number),a transition is made to step S319, and the marker recognition unit 12notifies the flight altitude control unit 15 that the number ofrecognized markers is less than the registered marker number, and theflight altitude control unit 15 determines whether or not the camera 22a can zoom out.

For example, the flight altitude control unit 15 issues a query to thezoom ratio control unit 17 regarding whether or not zooming out ispossible, and determines whether or not zooming out is possible, on thebasis of the response from the zoom ratio control unit 17. It should benoted that the determination regarding whether or not zooming out ispossible is not particularly restricted to the aforementioned example,and various alterations are possible; for example, the flight altitudecontrol unit 15 may determine whether or not zooming out is possible, bycomparing the present zoom ratio and the maximum value toward the wideside (the wide end) of the mounted camera 22 a, and the determinationmay be made by the zoom ratio control unit 17. The same is also true forother embodiments.

When it is determined that zooming out is possible, the flight altitudecontrol unit 15 instructs the zoom ratio control unit 17 to zoom out.Next, in step S320, the zoom ratio control unit 17 instructs the cameracontrol unit 27 to cause the lens of the camera 22 a to zoom out, andthe camera control unit 27 causes the lens of the camera 22 a to zoomout. Thereafter, a transition is made to step S312, and the processingthereafter is continued.

On the other hand, in step S319, when the flight altitude control unit15 has determined that zooming out is not possible, a transition is madeto step S307 depicted in FIG. 9, and a switch is made to processing toalter the flight altitude of the unmanned aerial vehicle 2 a by means ofthe flight altitude control unit 15.

Furthermore, in S313, when the number of recognized markers is theregistered marker number (the number is met), a transition is made tostep S314 in which the area of the polygon formed by the markers iscalculated. In step S314, the area calculation unit 13 detects thepositions of the markers using the camera image captured by the camera22 a, and obtains, as the altitude-maintained area, the area of thepolygon in which the detected markers serve as vertices.

Next, in step S315, the maximum-value detection unit 14, which storesthe area of the polygon previously calculated, compares the previousarea of the polygon (the altitude-maintained area previously calculated)and the present area of the polygon (the altitude-maintained area)calculated in step S314. When the present area of the polygon is smallerthan the previous area of the polygon, a transition is made to stepS316, and the maximum-value detection unit 14 notifies the flightaltitude control unit 15 that the present area of the polygon is smallerthan the previous area of the polygon, and the flight altitude controlunit 15 determines whether or not the camera 22 a can zoom in.

For example, the flight altitude control unit 15 issues a query to thezoom ratio control unit 17 regarding whether or not zooming in ispossible, and determines whether or not zooming in is possible, on thebasis of the response from the zoom ratio control unit 17. It should benoted that the determination regarding whether or not zooming in ispossible is not particularly restricted to the aforementioned example,and various alterations are possible; for example, the flight altitudecontrol unit 15 may determine whether or not zooming in is possible, bycomparing the present zoom ratio and the smallest value toward the teleside (the tele end) of the mounted camera 22 a, and the determinationmay be made by the zoom ratio control unit 17. The same is also true forother embodiments.

When it is determined that zooming in is possible, the flight altitudecontrol unit 15 instructs the zoom ratio control unit 17 to zoom in.Next, in step S317, the zoom ratio control unit 17 instructs the cameracontrol unit 27 to cause the lens of the camera 22 a to zoom in, and thecamera control unit 27 causes the lens of the camera 22 a to zoom in.Thereafter, a transition is made to step S312, and the processingthereafter is continued.

On the other hand, in step S316, when the flight altitude control unit15 has determined that zooming in is not possible, a transition is madeto step S306 depicted in FIG. 9, and a switch is made to processing toalter the flight altitude of the unmanned aerial vehicle 2 a by means ofthe flight altitude control unit 15.

Furthermore, when the present area of the polygon is equal to or largerthan the previous area of the polygon, the maximum-value detection unit14 notifies the flight altitude control unit 15 that the present area ofthe polygon is equal to or larger than the previous area of the polygon,and the flight altitude control unit 15, while maintaining the flightaltitude of the unmanned aerial vehicle 2 a, instructs the zoom ratiocontrol unit 17 to maintain the present zoom ratio of the camera 22 a,and a transition is made to step S311, and the processing thereafter isrepeated (step S318).

According to the aforementioned processing, the server device larecognizes, as markers, the ground-based robots captured using thecamera 22 a mounted on the unmanned aerial vehicle 2 a, and flies theunmanned aerial vehicle 2 a at an altitude that enables capturing of animage in which a polygon having the markers as vertices is formed andthe area of the polygon is maximized. Thereby, the flight altitude ofthe unmanned aerial vehicle 2 a reaches the optimum altitude forcapturing the region of interest as an image using the mounted camera 22a, and can appropriately capture the region of interest designated bythe markers on the ground,

Furthermore, there are also cases where, due to an obstacle on theground (a structure, a tree, or the like), the unmanned aerial vehicle 2a is unable to maintain the optimum altitude decided in theaforementioned processing, In these kinds of cases also, in the presentembodiment, the server device 1 a can increase the flight altitude ofthe unmanned aerial vehicle 2 a, and, after the obstacle has beenavoided, move the zoom ratio of the lens of the camera 22 a to the teleside, and it is therefore possible to obtain an appropriate image.

In the processing depicted in FIG. 9 and FIG. 10, the zoom ratio isaltered after the flight altitude has been adjusted, and, at a timingwhen it has become not possible to implement an adjustment by alteringthe zoom ratio, a switch is made to processing to alter the flightaltitude; however, it should be noted that the present disclosure is notrestricted thereto. Various alterations are possible, and it issufficient for the unmanned aerial vehicle 2 a to be controlled, usingboth alterations of the flight altitude and alterations of the zoomratio, in such a way that the area of the polygon captured by the camera22 a is maximized, The same is also true for other embodiments.

Embodiment 3

In a flight altitude control system according to embodiment 3 of thepresent disclosure, the number of markers to be recognized is notregistered in the system in advance, but rather a user selectsground-based robots to be used as markers from among a plurality ofground-based robots, and, using the selected markers, the flightaltitude of an unmanned aerial vehicle having an imaging device equippedwith a zoom lens mounted thereon is controlled, and also the zoom ratioof the imaging device is controlled.

FIG. 11 is a block diagram depicting an example of a configuration ofthe flight altitude control system in embodiment 3 of the presentdisclosure. It should be noted that, in FIG. 11, constituent elementsthat are the same as those in FIG. 8 are denoted by the same referencenumerals, and detailed descriptions thereof are omitted.

In FIG. 11, the flight altitude control system of the present embodimentis provided with a server device 1 b, an unmanned aerial vehicle 2 a,and a marker input device 3. The server device 1 b is provided with acommunication unit 11, a marker recognition unit 12, an area calculationunit 13, a maximum-value detection unit 14, a flight altitude controlunit 15, a zoom ratio control unit 17, and a marker selection unit 18.The unmanned aerial vehicle 2 a is provided with a communication unit21, a camera 22 a, a flight control unit 23, driving units 24, and acamera control unit 27, and is configured in the same way as theunmanned aerial vehicle 2 a depicted in FIG. 8. The marker input device3 is provided with a communication unit 31, an input unit 32, and adisplay unit 33.

In the present embodiment, the number of the ground-based robotsdeployed on the ground is not registered in the system in advance, andthe server device 1 b is provided with the marker selection unit 18instead of the marker number storage unit 16 depicted in FIG. 8.

The communication unit 31 of the marker input device 3, via a network NW(not depicted), communicates with the communication unit 11 of theserver device 1 b, receives information from the communication unit 11,such as an image captured by the camera 22 a received by the markerrecognition unit 12 and the positions of markers recognized by themarker recognition unit 12, and outputs the information to the displayunit 33. The display unit 33 displays an input screen in which aplurality of candidate markers that indicate the positions of theplurality of markers (the plurality of ground-based robots) recognizedby the marker recognition unit 12 are superimposed on the image capturedby the camera 22 a. The input unit 32 acquires an operation input by theuser, and is configured of a touch sensor formed on a screen (displayscreen) of the display unit 33, for example.

The user selects desired candidate markers using the input unit 32 fromamong the plurality of candidate markers displayed on the input screenof the display unit 33, and thereby selects, from among the plurality ofground-based robots, a plurality of ground-based robots that the userwishes to be captured by the camera 22 a. At such time, the input unit32 transmits the plurality of candidate markers selected by the user, tothe communication unit 11 via the communication unit 31, asrecognition-subject markers.

It should be noted that the configuration of the marker input device 3is not particularly restricted to the aforementioned example, and acontrol device which is external to an unmanned aerial vehicle that isconnected wirelessly or by means of optical communication or the like,for example, a PROPO controller, may also function as the marker inputdevice 3.

FIG. 12 is a diagram depicting an example of the input screen displayedon the display unit 33 depicted in FIG. 11. As depicted in FIG. 12, inan input screen IS, for example, five candidate markers M1 to M5 thatindicate the positions of five robots are displayed superimposed on acaptured image. The user selects, from among the five candidate markersM1 to M5 displayed, the ground-based robots to be used asrecognition-subject markers. In the example depicted in FIG. 12, thefour candidate markers M1 to M4 selected by the user are displayed asblack dots, and the candidate marker M5 not selected by the user isdisplayed as a white dot. In this way, an image captured by the camera22 a is displayed on a screen equipped with touch sensors, and by meansof a simple operation such as ground-based robots of interest to theuser being designated on the displayed screen as recognition-subjectmarkers, it is possible for desired ground-based robots to be selectedas recognition-subject markers.

Referring to FIG. 11 once again, the marker selection unit 18 of theserver device 1 b receives a plurality of recognition-subject markerstransmitted from the marker input device 3 via the communication unit11, and stores the information of three or more recognition-subjectmarkers as registered marker information.

FIG. 13 is a diagram depicting an example of data retained by the markerselection unit 18 depicted in FIG. 11. As depicted in FIG. 13, themarker selection unit 18 stores, as registered markers, the plurality ofrecognition-subject markers selected by the user using the marker inputdevice 3, and associates and stores a marker ID (identificationinformation) of each of the recognition-subject markers and coordinates(X and Y) constituting position information, for example, latitude andlongitude information.

Specifically, the marker recognition unit 12, when having recognized themarkers, determines the marker ID and position information of each ofthe markers using map data stored in advance, and transmits the markerIDs and position information to the marker input device 3, the inputunit 32 transmits the marker IDs and position information of therecognition-subject markers selected by the user to the marker selectionunit 18, and the marker selection unit 18 stores the transmitted markerIDs and position information.

It should be noted that the method for acquiring position information isnot particularly restricted to the aforementioned example; for example,a positioning system such as the Global Positioning System (GPS) or theGlobal Navigation Satellite System (GLONASS) may be used for theunmanned aerial vehicle 2 a to acquire its own position and transmit theposition to the server device 1 b or the marker input device 3, with theposition of each of the ground-based robots being determined based onthe position of the unmanned aerial vehicle 2 a, or for the ground-basedrobots to acquire their own positions and transmit the positions to theserver device 1 b or the marker input device 3. Furthermore, the dataretained by the marker selection unit 18 is not particularly restrictedto the aforementioned example, and in a similar manner to FIG. 4, thenumber of recognition-subject markers may be stored as the registeredmarker number.

Referring to FIG. 11 once again, the marker recognition unit 12 acquiresan image captured by the camera 22 a via the communication unit 21, andrecognizes the ground-based robots that correspond with therecognition-subject markers stored in the marker selection unit 18, asmarkers, from among the ground-based robots captured by the camera 22 a.The marker recognition unit 12 compares the number of the plurality ofrecognized markers and the number of recognition-subject markers storedin the marker selection unit 18, outputs the comparison result to theflight altitude control unit 15, and also outputs the image captured bythe camera 22 a and the comparison result to the area calculation unit13. Here, the marker recognition unit 12 may not only compare the numberof the plurality of recognized markers and the number ofrecognition-subject markers stored in the marker selection unit 18 butmay also compare the position information of each of the markers.

When the number of markers recognized by the marker recognition unit 12and the number of recognition-subject markers stored in the markerselection unit 18 match, the area calculation unit 13 uses the imagecaptured by the camera 22 a to calculate the area of the polygon formedby the recognition-subject markers stored in the marker selection unit18, and outputs the calculated area of the polygon to the maximum-valuedetection unit 14.

The maximum-value detection unit 14, the flight altitude control unit15, and the zoom ratio control unit 17 are configured in the same wayand operate in the same way as the maximum-value detection unit 14, theflight altitude control unit 15, and the zoom ratio control unit 17depicted in FIG. 8.

According to the above configuration, the unmanned aerial vehicle 2 aconstantly captures images of below the position where the unmannedaerial vehicle 2 a is flying, by means of the camera 22 a. The regioncaptured by the camera 22 a of the unmanned aerial vehicle 2 a changesdepending on the flight altitude of the unmanned aerial vehicle 2 a andthe zoom ratio of the zoom lens mounted in the camera 22 a, That is, theregion being captured widens as the unmanned aerial vehicle 2 a causesthe zoom lens to zoom out from the tele (telephoto) side toward the wide(wide angle) side. Furthermore, the region being captured narrows as theunmanned aerial vehicle 2 a causes the zoom lens to zoom in from thewide (wide angle) side toward the tele (telephoto) side.

In the present embodiment also, as an initial state, the zoom ratio ofthe camera 22 a is set to the maximum value on the wide side (the wideend), in other words, to a state in which the greatest number of objectscan be captured at the maximum angle of view. A plurality ofground-based robots that serve as markers are deployed below theunmanned aerial vehicle 2 a, and, due to the camera 22 a capturing animage thereof, a polygon is generated in which the positions of theground-based robots serve as vertices. This situation is the same as thesituation described in FIG. 5 and FIG. 6.

Here, in the present embodiment, if the flight altitude of the unmannedaerial vehicle 2 a is low, it is assumed that all of therecognition-subject markers (all of the registered markers) stored inthe marker selection unit 18 are not captured in the image captured bythe camera 22 a, and that all of the registered markers cannot berecognized.

Therefore, the server device 1 b, as an initial state, increases theflight altitude of the unmanned aerial vehicle until all of theregistered markers are recognized. In the process of the unmanned aerialvehicle 2 a monotonously increasing the flight altitude, the camera 22 astarts capturing images of the ground-based robots serving as markers(hereinafter, also referred to as “markers”). When the camera 22 acaptures the markers, the marker recognition unit 12 recognizes theground-based robots as markers.

At such time, the marker recognition unit 12 treats the recognizedmarkers as candidate markers and transmits, to the marker input device3, the image of the camera 22 a with the candidate markers superimposedthereon, and the user uses the marker input device 3 to select candidatemarkers (ground-based robots) to be used, from among the plurality ofcandidate markers (ground-based robots) displayed superimposed on thecaptured image.

When the candidate markers are selected, the marker input device 3transmits the selected candidate markers as recognition-subject markersto the server device 1 b, and the area calculation unit 13 calculatesthe area of a polygon formed by the recognition-subject markers(registered markers).

Thereafter, the area of the polygon is related to the flight altitude ofthe unmanned aerial vehicle 2 a, and, when the flight altitude of theunmanned aerial vehicle 2 a is increased, the area of the polygondecreases. On the other hand, when the flight altitude of the unmannedaerial vehicle 2 a is decreased, the area of the polygon increases, andeventually the markers fall outside of the angle of view of the camera22 a, and therefore a state is entered where it is not possible todetect a polygon in which the recognition-subject markers (registeredmarkers) serve as vertices.

Furthermore, the area of the polygon is related to the zoom ratio of thezoom lens of the camera 22 a, and, when the camera 22 a zooms out (movesfrom the tele side to the wide side), the area of the polygon decreases.On the other hand, when the camera 22 a zooms in (moves from the wideside to the tele side), the area of the polygon increases, and there isa possibility of a state eventually being entered where it is notpossible to detect a polygon in which the recognition-subject markers(registered markers) serve as vertices.

At such time, the flight altitude control unit 15 changes the flightaltitude of the unmanned aerial vehicle 2 a, and, based on thecomparison result of the maximum-value detection unit 14, determines theflight altitude of the unmanned aerial vehicle 2 in such a way that thearea of the polygon captured by the camera 22 a is maximized.

In this case also, the ground-based robots that constitute markers areconstantly moving, and therefore the area of the polygon changes frommoment to moment. The maximum-value detection unit 14 sequentiallycalculates this changing area of the polygon as the altitude-maintainedarea, and the zoom ratio control unit 17 controls the zoom ratio of thecamera 22 a in such a way that the area of the polygon drawn by themarkers (the altitude-maintained area) is maximized. Furthermore, whenthe markers move continuously, the unmanned aerial vehicle 2 a may beconfigured in such a way as to automatically track therecognition-subject markers (registered markers) stored in the markerselection unit 18.

Next, flight altitude control processing performed by the server device1 b depicted in FIG. 11 will be described using the flowcharts of FIG.14 and FIG. 15. FIG. 14 and FIG. 15 are first and second flowchartsdepicting an example of flight altitude control processing performed bythe server device 1 b depicted in FIG. 11, Here, it is assumed that, bythe time the unmanned aerial vehicle 2 a has been raised by a manualoperation of the user, the recognition-subject markers (registeredmarkers) that serve as vertices of the polygon are already stored in themarker selection unit 18.

In FIG. 14, first, the server device 1 b starts flight altitude controlprocessing (step S601). Next, in step S602, the marker recognition unit12 acquires the image captured by the camera 22 a and recognizesmarkers.

Next, in step S603, the marker recognition unit 12 confirms whether ornot all of the registered markers stored in the marker selection unit 18have been recognized. When there are insufficient recognized markers, atransition is made to step S607, and the marker recognition unit 12notifies the flight altitude control unit 15 that all of the registeredmarkers have not been recognized, and instructs the flight altitudecontrol unit 15 to increase the flight altitude of the unmanned aerialvehicle. The flight altitude control unit 15 controls the flightaltitude of the unmanned aerial vehicle 2 a according to theinstruction.

On the other hand, when all of the registered markers have beenrecognized, a transition is made to step S604 in which the area of thepolygon formed by the registered markers is calculated. In step S604,the area calculation unit 13 detects the positions of the registeredmarkers using the image captured by the camera 22 a, and obtains thearea of the polygon in which the detected registered markers serve asvertices.

Next, in step S605, the maximum-value detection unit 14, which storesthe area of the polygon previously calculated, compares the previousarea of the polygon and the present area of the polygon calculated instep S604. When the present area of the polygon is smaller than theprevious area of the polygon, a transition is made to step S606, and themaximum-value detection unit 14 notifies the flight altitude controlunit 15 that the present area of the polygon is smaller than theprevious area of the polygon, and instructs the flight altitude controlunit 15 to decrease the altitude of the unmanned aerial vehicle 2 a. Theflight altitude control unit 15 controls the flight altitude of theunmanned aerial vehicle 2 a in accordance with the instruction.

On the other hand, when the present area of the polygon is equal to orlarger than the previous area of the polygon, the maximum-valuedetection unit 14 notifies the flight altitude control unit 15 that thepresent area of the polygon is equal to or larger than the previous areaof the polygon, and the flight altitude control unit 15, whilemaintaining that flight altitude, transitions to step S611 depicted inFIG. 15 (step S608).

Next, in FIG. 15, the server device 1 b starts adjustment processingaccording to the zoom ratio (step S611). Next, in step S612, the markerrecognition unit 12 acquires the image captured by the camera 22 a andrecognizes markers.

Next, in step S613, the marker recognition unit 12 confirms whether ornot all of the registered markers stored in the marker selection unit 18have been recognized. When there are insufficient recognized markers, atransition is made to step S619, and the marker recognition unit 12notifies the flight altitude control unit 15 that not all of theregistered markers have been recognized, and the flight altitude controlunit 15 determines whether or not the camera 22 a can zoom out.

When it is determined that zooming out is possible, the flight altitudecontrol unit 15 instructs the zoom ratio control unit 17 to zoom out.Next, in step S620, the zoom ratio control unit 17 instructs the cameracontrol unit 27 to cause the lens of the camera 22 a to zoom out, andthe camera control unit 27 causes the lens of the camera 22 a to zoomout. Thereafter, a transition is made to step S612, and the processingthereafter is continued.

On the other hand, in step S619, when the flight altitude control unit15 has determined that zooming out is not possible, a transition is madeto step S607 depicted in FIG. 14, and a switch is made to processing toalter the flight altitude of the unmanned aerial vehicle 2 a by means ofthe flight altitude control unit 15.

Furthermore, in step S613, when all of the registered markers have beenrecognized, a transition is made to step S614 in which the area of thepolygon formed by the registered markers is calculated. In step S614,the area calculation unit 13 detects the positions of the registeredmarkers using the image captured by the camera 22 a, and obtains, as thealtitude-maintained area, the area of the polygon in which the detectedregistered markers serve as vertices.

Next, in step S615, the maximum-value detection unit 14, which storesthe area of the polygon previously calculated, compares the previousarea of the polygon (the altitude-maintained area previously calculated)and the present area of the polygon (the altitude-maintained area)calculated in step S614. When the present area of the polygon is smallerthan the previous area of the polygon, a transition is made to stepS616, and the maximum-value detection unit 14 notifies the flightaltitude control unit 15 that the present area of the polygon is smallerthan the previous area of the polygon, and the flight altitude controlunit 15 determines whether or not the camera 22 a can zoom in.

When it is determined that zooming in is possible, the flight altitudecontrol unit 15 instructs the zoom ratio control unit 17 to zoom in.Next, in step S617, the zoom ratio control unit 17 instructs the cameracontrol unit 27 to cause the lens of the camera 22 a to zoom in, and thecamera control unit 27 causes the lens of the camera 22 a to zoom in.Thereafter, a transition is made to step S612, and the processingthereafter is continued.

On the other hand, in step S616, when the flight altitude control unit15 has determined that zooming in is not possible, a transition is madeto step S606 depicted in FIG. 14, and a switch is made to processing toalter the flight altitude of the unmanned aerial vehicle 2 a by means ofthe flight altitude control unit 15.

Furthermore, when the present area of the polygon is equal to or largerthan the previous area of the polygon, the maximum-value detection unit14 notifies the flight altitude control unit 15 that the present area ofthe polygon is equal to or larger than the previous area of the polygon,and the flight altitude control unit 15, while maintaining the flightaltitude of the unmanned aerial vehicle 2 a, instructs the zoom ratiocontrol unit 17 to maintain the present zoom ratio of the camera 22 a,and, while the flight altitude of the unmanned aerial vehicle 2 a andthe present zoom ratio of the camera 22 a are maintained, a transitionis made to step S611, and the processing thereafter is repeated (stepS618).

According to the aforementioned processing, the server device 1 brecognizes, as markers, the ground-based robots selected by the user,from among the ground-based robots captured using the camera 22 amounted on the unmanned aerial vehicle 2 a, and flies the unmannedaerial vehicle 2 a at an altitude that enables capturing of an image inwhich a polygon having the markers as vertices is formed and the area ofthe polygon is maximized. Thereby, the flight altitude of the unmannedaerial vehicle 2 a reaches the optimum altitude for capturing a regionof interest as an image using the mounted camera 22 a, and canappropriately capture a region of interest designated by ground-basedrobots selected by the user.

Furthermore, there are also cases where, due to an obstacle on theground (a structure, a tree, or the like), the unmanned aerial vehicle 2a is unable to maintain the optimum altitude decided in theaforementioned processing. In these kinds of cases also, in the presentembodiment, the server device 1 b can increase the flight altitude ofthe unmanned aerial vehicle 2 a, and, after the obstacle has beenavoided, move the zoom ratio of the lens of the camera 22 a to the teleside, and it is therefore possible to appropriately capture a region ofinterest designated by the ground-based robots selected by the user.

With the flight altitude control device and the like according to thepresent disclosure, it becomes possible to appropriately control theflight altitude of an unmanned aerial vehicle in order for the unmannedaerial vehicle to be flown in the air, appropriate information regardinga disaster-affected area to be captured from the unmanned aerialvehicle, and information to be shared with relevant people, when robots,people, or the like deployed on the ground are to carry out activitiesin a disaster-affected area at the time of a disaster or the like.Furthermore, the flight altitude control device and the like accordingto the present disclosure can also be applied for monitoring uses forsecurity or the like, or maintenance uses for a dam, a bridge pier, orthe like, and are therefore useful for a flight altitude control deviceor the like that controls the flight altitude of an unmanned aerialvehicle having mounted thereon an imaging device that captures theground.

What is claimed is:
 1. A device that controls a movement direction of anunmanned aerial vehicle having mounted thereon an imaging device thatcaptures an image, the device comprising: one or more memories; and aprocessor which, in operation, recognizes, as a plurality of markers, aplurality of objects from the image captured by the imaging device, eachof the plurality of markers attached to one of the plurality of objects,calculates an area of a polygon formed by the plurality of markers, andcontrols the movement direction of the unmanned aerial vehicle such thatthe area of the polygon is maximized.
 2. The device according to claim1, further comprising: a memory that stores a number of the markers tobe recognized by the processor, as a registered marker number, whereinthe processor compares the number of the plurality of markers and theregistered marker number, when the number of the plurality of markers isless than the registered marker number, controls the movement directionof the unmanned aerial vehicle such that the unmanned aerial vehiclemoves away from the plurality of markers.
 3. The device according toclaim 1, further comprising: a memory that stores a number of themarkers to be recognized by the processor, as a registered markernumber, wherein the processor compares the number of the plurality ofmarkers and the registered marker number, when the number of theplurality of markers matches the registered marker number, controls themovement direction of the unmanned aerial vehicle such that the unmannedaerial vehicle moves toward the plurality of markers.
 4. The deviceaccording to claim 2, wherein the imaging device includes a zoom imagingdevice capable of a zoom operation, and the processor, recognizes theplurality of objects as the plurality of markers, from the imagecaptured by the imaging device, calculates, the area of the polygonformed by the plurality of markers recognized, and controls a zoom ratioof the zoom imaging device such that the area is maximized.
 5. Thedevice according to claim 4, wherein, when the number of the pluralityof markers recognized is less than the registered marker number, theprocessor controls the zoom imaging device in such a way that the zoomimaging device zooms out.
 6. The device according to claim 5, wherein,when the zoom imaging device cannot zoom out, the processor maintainsthe present zoom ratio of the zoom imaging device, and controls themovement direction of the unmanned aerial vehicle such that the unmannedaerial vehicle moves away from the plurality of markers.
 7. The deviceaccording to claim 4, wherein, when the number of the plurality ofmarkers recognized matches the registered marker number, and the area issmaller than the area previously calculated, the processor controls thezoom imaging device such that the zoom imaging device zooms in.
 8. Thedevice according to claim 7, wherein, when the zoom imaging devicecannot zoom in, the processor maintains the present zoom ratio of thezoom imaging device, and controls the movement direction of the unmannedaerial vehicle such that the unmanned aerial vehicle moves toward theplurality of markers.
 9. The device according to claim 8, wherein theprocessor acquires, as a plurality of recognition-subject markers, aplurality of objects selected by a user from among the plurality ofobjects, recognizes the plurality of recognition-subject markers as theplurality of markers, from the image captured by the imaging device, andcalculates the area of the polygon formed by the plurality ofrecognition-subject markers.
 10. The device according to claim 9,wherein the processor acquires, as the plurality of recognition-subjectmarkers, the plurality of markers selected by the user from among theplurality of markers, which are displayed superimposed on the imagecaptured by the imaging device.
 11. An unmanned aerial vehicle,comprising: an imaging device that captures an image; and a processorwhich, in operation, recognizes, as a plurality of markers, a pluralityof objects from the image captured by the imaging device, each of theplurality of markers attached to one of the plurality of objects,calculates an area of a polygon formed by the plurality of markers, andcontrols a movement direction of the unmanned aerial vehicle such thatthe area of the polygon is maximized.
 12. A method, comprising:recognizing, as a plurality of markers, a plurality of objects from animage captured by an imaging device mounted on an unmanned aerialvehicle,. each of the plurality of markers attached to one of theplurality of objects; calculating, by a processor, an area of a polygonformed by the plurality of markers; and controlling a movement directionof the unmanned aerial vehicle such that the area of the polygon ismaximized.
 13. A computer-readable non-transitory recording mediumhaving recorded thereon a program that controls an unmanned aerialvehicle having mounted thereon an imaging device that captures an image,wherein the program, when executed by a processor, causes the processorto execute operations including: recognizing, as a plurality of markers,a plurality of objects from the image captured by the imaging device,each of the plurality of markers attached to one of the plurality ofobjects; calculating an area of a polygon formed by the plurality ofmarkers; and controlling a movement direction of the unmanned aerialvehicle such that the area of the polygon is maximized.